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(54) System and metfiod for on-line multimedia access 

(57) Disclosed is a method and system for providing 
access to multimedia content on-line which is updated 
virtually simultaneously with the vendor's update proc- 
ess. By a user accessing a page on the World Wide 
Web. for example, data (encrypted and unencrypted) 
and instructions are automatically downloaded to a 
user's computer system for quicli access. Depending 
upon the user's computer system (LAN or a stand-alone 
personal computer), "applets" containing data and 
instructions are stored for immediate access. In a Kara- 
oke application of this invention, where the user desires 
to access songs which are most popular at a given time, 
the user accesses a page where a song list and other 
information is displayed on a display apparatus. When 
the user clicks on a particular song of the song list, the 
applet executes an authentication request. If the user is 
authenticated, the authentication is downloaded as part 
of the applet containing the desired multimedia contort 
(or s^arately depending upon the circumstances). 
According to this Invention, an applet includes multime- 
dia elements which further include timing codes and a 
synchronization function which provides for the syn- 
chronization of the delivery of the multimedia elements. 
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Description 

This invention relates to access to encrypted multi- 
media content data over an Intemet-type distribution 
system. 5 

Traditional forms of entertainment are becoming 
increasingly digitized and accessible to a wider audi- 
ence. For example, in Japan, a popular form of enter- 
tainment Karaoke, is available to a wider participating 
audience as a result of digitization. Because digitization 10 
reduces the cost of many products and services, Kara- 
oke "juke boxes" are found in many business establish- 
ments so that their patrons may enjoy their use. 

Digitized Karaoke juke boxes are an improvement 
over traditional juke boxes. Instead of replacing vinyl is 
records, a service technician visiting eacli site simply 
loads software to update tiie song choices available to 
the user witfi the latest music. IMoreover, on a display, 
words can be scrolled at the same time as the music 
plays. This multimedia Karaoke experience, while an 20 
improvement over tradKional juke tKsxes, howe\/er, is 
expensive since it requires service calls by technicians 
for updating. Moreover, there is a lag between the 
release of a song and the time it is installed on a Kara- 
oke juke box. Furthermore, the Karaoke song list tx>oks 2S 
are printed on paper and thus are easily lost, damaged 
or destroyed. Additionally, in accounting, rt is difficult to 
keep track of the songs which have been pl^ed so that 
royalties may be paid to the artists. A new mettuxi and 
apparatus which does not require visits by techniciane so 
to Karaoke sites and resolves the other problems 
described above would be beneficial. 

While Karaoke is enjoyed by patrons of business 
establishments, home Karaoke participation is currently 
limited to playing and singing along with a record or CD. ss 
Some of the disadvantages to a home Karaoke partici- 
pant include that he/she must leave home to purchase 
the music content and that he/she does not have the 
sing-along aid of saolling words. 

As more users access the Internet and the associ- 40 
ated World-Wide-Web, more vendors are providing mul- 
timedia content data which is readily accessible by 
consumers. Depending upon the bandwidtii capatMlity 
of the transmission hardware, among other things, dif- 
ferent types of content are accessitsle by consumers, 4s 
including video, audio, graphic and ASCII data. Moreo- 
ver, particulariy with the advent of browser technology, 
such as Netscape, a user can readily access data from 
servers all over the world. 

Recentiy, new programming lianguages have been so 
developed which allows programs to be written which 
enhance browser technology. While not widely used yet. 
programs which are written in these languages can be 
embedded into a browser and promise to provide a user 
with a neariy seamless on-line multimedia experience, ss 
Such a language, Java (TM) language, has been devel- 
oped by Sun MicrosystemsXR) Computer Corporation. 
Java is an object-oriented language similar to C-m- 



in many ways, but specifrcally developed to provide 
cross-platform capability and reduce the complexities of 
C++. Generally speaking, an object-oriented language 
facilitates the clean definition of interfaces and makes it 
possible to provide reusable "software ICs." Java pro- 
vides multimedia capabilities which are operating sys- 
tem and hardware independent. The Java software 
architecture is designed to support platforms ranging 
from personal oomputerB to embedded network devices 
of the type similar to a Java desktop device (recentiy 
announced by Sun and Oracle). Sun Microsystems has 
a Java homepage where the Java language specifica- 
tions can be accessed among other instructive pro- 
gramming materials at 
Httpy/JAVA.SUN.COiyA/doc/Ovenriew^ava/index.html. 

It would be beneficial to both commercial and home 
users fbr the cfistribution of Karaoke and other midtime- 
dia content to be provided on-line by an Internet-type 
distribution system. ^ 

Particular and preferred aspects of the invention 
are set out in the accompanying independent and 
dependent Claims. Features of the dependent Claims 
may be combined with tiiose of the Independent Claims 
as appropriate and In combinations otiier than those 
explicttiy set out in the Claims. 

A user of this invention Is able to access muKimedra 
content on-line which is updated virtually simultane- 
ously with the vendor's update process. In the event tiiat 
a vendor updates the data frequentiy, the user will ben- 
efit tremendously, never experiencing a lag between the 
newest content and the delivery thereof. By a user 
accessing a page on the World Wide Web. fbr example, 
data (encrypted and unencrypted) and Instructions are 
automatically downloaded to a user's computer system 
fbr quick access. Depending upon the user's computer 
system (LAN or a stand-atone personal computer), 
"applets" containing data and instructions are stored fbr 
immediate access. An applet in and of itself may contain 
a plurality of components, and a single click by the user 
may generate a download which fetches a plurality of 
applets. In any case, the applets are available fbr virtu- 
ally immediate execution, making the multimecfia expe- 
rience seamless to the user. 

Fbr example, in a Karaoke application of this inven- 
tion, where the user desires to access songs whk:h are 
most popular at a given time, the user is completely 
unaware of the automatic delivery of an applet Including 
data and instructions from a main data base server. 
When the user accesses a page, a song list and other 
information is displayed on a display apparatus. When 
the user clicks on a particular song of the song list, tiie 
applet executes an authentication request. If the user is 
authenticated, the authentication is downloaded as part 
of the applet containing tiie desired multimedia content 
(or separately depending upon the circumstances). In 
the meantime, a new song may have reached number 
one standing in the charts, and the vendor has updated 
the main data base accordingly. While the user is still on 
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the page, an applet containing a new song list is down- 
loaded to user's computer system, so that in the near 
future, when the user goes to dick another song for 
playing, the song list is updated and Indudes the newest 
and most popular songs. 5 

A multimedia experience, inherent in Its nature, will 
include drfferent types of media content For a seamless 
experience, each element's timing must be coordinated 
with the other elements' timing. According to this inven- 
tion, an applet indudes multimedia elements which fur- io 
ther include timing codes and a synchronization 
function which provides for the synchronization of the 
delivery of the multimedia elements. 

Exemplary embodiments of the invention are 
desalbed hereinafter, by way of example only, with ref- is 
erence to the accompanying drawings in which: 

Rgure 1 is an overview of a distribution system 

used in conjunction with this invention: 

Rgure 2 shows display screen output, among other 2o 

things, offering a user song choices for a Karaolce 

application of this invention; 

Rgure 3 is a f fow chart of choices provided to a user 

in a Karaoke application; 

Rgure 4 is a flow chart Illustrating the threads for ^ 
delivery of the different multimedia content compo- 
nents; 

Rgure 5 is a diagram illustrating tiie embedded 
nature of Java in a browser; 

Rgure 6 is a flow chart illustration an authentication so 
procedure of this invention; 
Rgure 7 is a flow chart illustrating an chose and 
play sequence of this invention; 
Rgure 8 is a flow chart illustrating a method of syn- 
chronization of multimedia elements: 3S 
Rgure 9 is a flow chart illustrating another method 
of synchronization of multimedia elements; and 
Rgure 10 is a flow chart illustrating yet another 
method of synchronization of multimedia elements 
according to this invention. 4o 

A user wishing to access a Karaoke application pro- 
vided in accordance with this invention will access a 
Karaoke page via a browser such as Netscape. The 
browser supports Java so that the use of Java provides 45 
multimedia capabilities which are operating system and 
hardware independent. Accordingly, an applet induding 
encrypted and unencrypted data and Instmctions will be 
delivered to the user's computer system to enable the 
user to make choices and thus send a request to a so 
remote server for the delivery of multimedia content. 
Once authentication has taken place, one or more 
applets are sent by the remote server which defiver the 
multimedia content. 

Applets are stored in a network of servers for effi- ss 
dent delivery to a user. FIG. 1 shows a main database 
72 in communication with caching sutTservers 74a. 74b, 
74c 74d and 74e. The main server defines tiie master 



database of all songs released. This database can rely 
on arry knovim database technology whose hardware 
will usually reside at tiie central distribution site for data 
defined by tiie implementor. Multiple main servers are 
permitted for redundancy. 

Caching sut>server8 define a location specific 
server which caches songs for disti-ibution to local Kara- 
oke dients. The purpose of the caching subservers is to 
reduce load on tiie main server generated by song 
requests, and reduce long distance network traffic to the 
main server by caching songs locally. If a caching server 
does not have in memory, a song, it will request it from 
the nnaster list. Subsen^er 74e is further shown In com- 
munication with subservers 76a, 76b and 76c. Net- 
worked computers may be arranged In other 
configurations as well. 

An an-ay of dedicated Karaoke terminals 78a. 78b 
and 78c are in communication wKh subservers 74b. 74c 
and 74d respectively. The Karaoke terminal plays the 
songs but also may include, but is not required to have 
digital signal processing capability, stereo sound, 
remote control, a keyboard and a mouse. Alternatively, 
the Karaoke page is accessed, for example, by a user's 
personal computer. LAN, laptop. PDA, workstation, tele- 
vision or telephone 82a, 82b or 82c, wireless or wired, 
in any manner of transmission from a remote source, 
applets are automatically downloaded onto the user's 
computer system upon access to the page as described 
atx3ve. ^ 

Turning to FIG. 2. an example of a Karaoke page 1 0 
on a display apparatus is shown. The user will view a 
song list 12 such as that shown on the left side of page 
10. While the user scrolls the song list, various informa- 
tion is provkJed. For example, a song's standing In the 
charts at that particular time. Its length and any other 
Information pertinent to the song is optionally provided. 
Because a song's current standing in the charts is infor- 
mation which can change at any given moment, such 
information when available is automatically downloaded 
to the user while the user maintains access to the page. 
New songs which are released may also be down- 
loaded to the user while the user medntains access to 
the page. Moreover, as the user is scrolling through the 
song list, still photographs or video clips of the perform- 
ances by the artists are also provkJed. 

The user will use the dick of a mouse, or other input 
device, to choose a song 14 on the song list 12. As 
shown In FIG. 2. a user chose tiie song Boy Meets Girl 
by TRF To the right side of the song list on tiie page, 
graphics, animation or a video 16 by the group TRF are 
shown. As the song plays, the words to the song are 
also displayed. As shown In FIG. 2. tiie words are *^Noo 
woo woo wo. BOY MEETS GIRL" 

As the song continues to play and new verses are 
sung by the performer, the words displayed will change. 
Words (ASCII data) 18 may be displayed, tor example. 
In segments or one at a time. In either event, tiie words 
displayed are synchronized with the words sung by the 
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performer. In the case where a segment of words is dis- 
played, the words on the screen are simultaneously 
highlighted against the baclcground 22. l-(ighlighting 
may instead be provided, for example, in a traditional 
bouncing ball format. An applet delivering multimedia 5 
content in accordance with this invention therefore 
includes the multimedia content data as well as instruc- 
tions for providing the synchronization of different multi- 
media elements as will be described in detail below with 
reference to FIGS. 8-10. ,0 

The initial applet or applets delivered to the user 
may provide a number of choices to the user. The flow- 
chart of FIG. 3 shows steps to can-y out a selection 
process provided by the initially delivered applet or 
applets. When the user accesses a Web page 1 0 at box is 
30. he/Bhe may make a choice from ASCII song list 14 
at box 32. As mentioned above, components such as 
graphics, video and audio may also be delivered by an 
initial applet at box 34. Thus, as the song list scrolls at 
box 34. graphics, video, audio cuts from the songs or 20 
ASCII data such as a song's current standing may be 
accessed at boxes 36 and 38. Having decided upon a 
song, the user elicits to indicate his/her choice at box 42. 
User options include whether the song should be played 
with or without vocals at box 44; whether to raise or ss 
lower the key at box 46; a record of the number of times 
the song has been played by the user at box 48; 
whether to display video or graphics by the artist for an 
additional fee at box 52; whether to abort choice at box 
54. Alternatively, the choices between boxes 44-54 may 30 
be suppressed or not offered. The selection is played at 
box 56. Once concluded, at box 58 the choice of 
whether to continue or to end is provided at boxes 62 
and 64 respectively. Moreover, one of the above 
described user option boxes can include other features. 3B 
such as to chose the language in which tiie vocalization 
Is sung, for example, English or Japanese; whether the 
voice is female or male, tenor, alto or soprano; whether 
the voice is to sing a harmony witfi the original base 
melody; or whether to change tfie tempo or style of the 4o 
song, for example, to a rap version, a easy listening ver- 
sion or country version. 

After an initial applet is delivered, the multimedia 
content is delivered upon request, providing that the 
user has been authenticated. Turning to the flow chart 4S 
of FIG. 4, when the user clicks on a home page with the 
browser, a server delivers the most current applet at 
boxes 84 and 86. After the song selection at box 42 (see 
FIG. 3) tiie applet calls back to the database (stored on 
main server 72 or a subserver) to request audio, video, so 
timing and lyric information at box 88. At box 92. to 
deliver the content in a synchronized manner, the applet 
forks threads of control to fetch various data as shown 
the next boxes. 94. 96, 98, 102 and 104. At box 106, 
when the data is delivered to the user's computer sys- ss 
tem, it is assembled and played. 

Since the delivered content data is encrypted, a key 
is needed for a user to decrypt it The key may have 



been delivered with the initial applet or later. In any 
event, the key will not be provided to the user until tiie 
user has been authenticated. Authentication, for exam- 
ple, includes verifying payment data, a user password 
or a handshake witii a form of personal identification 
such as a PCMCIA43ased card, for example, a credit, 
debit prepaid cash card or smart card. 

FIG. 6 is a ftowchart of tiie authentication thread 
104 of FIG. 5. The authentication of this invention 
includes cryptographic portion and security access por- 
tions that control permissions for users to access songs, 
registration of usage of songs, data encryption of digital 
data, and valki usage lifetime of encrypted data (cf. 
http/Awww.omg.org follow linte to security API for 
CORB^. That is. after an initial applet Is delivered, and 
a user makes a choice and a request at box 108, 
authentication may be delivered before, at tiie same 
time or after the muKimedia content elements are deliv- 
ered depending on. for example, where particular 
threads of the applet shown in FIG. 4 are stored. 
Encrypted data is downloaded to the user at box 114 
and stored on the user's computer system. 

Upon authentication, a key is provided to the user to 
decrypt the multimedia content data so that the song 
plays at box 118. Depending upon the Karaoke busi- 
ness operation, tiie key may be disposable and tiiere- 
fore expire immediately upon decrypting the data, or 
may expire after a predetermined number of plays or 
within a time period such as twenty-four hours at box 
122. With tiie ease of delivery of applets, a plurality of 
keys may be downloaded to a user's computer system 
in a manner invisible to the user. Moreover, as disposa- 
ble keys are used, replacement keys are sent to the 
user's computer system for use later during the session. 
Once the user logs off page 10 at box 126, applets are 
removed from tiie user's computer system's memory. In 
this manner, piracy of content is particularly difficult 
since one key will decrypt encrypted data for one song 
which can expire after one play. Accordingly, access is 
more secure and thus multimedia content is better pro- 
tected. 

As mentioned above. Applets may be updated by 
the vendor and then automatically downloaded at any 
given time by the server. Turning to FIG. 6, an overview 
of particular elements of an applet is shown. As dis- 
cussed above. Java applets 108 are embedded in tfie 
browser 1 12. The applet elements include data 1 14 and 
instructions 116 (functionality) which acts upon tiie 
data. The data is either unencrypted or encrypted data, 
the latter of course needing a key for the user's access. 

The functionality 1 1 6 is provided by a set of instruc- 
tions operating on applet data 114. Digital signal 
processing (DSP) functionality includes features shown 
in FIG. 3 used to lower or raise the song's key (box 46), 
to choose a song with or without vocals (box 44) or to 
slow or speed the song's tempo. Compression of data 
(and therefore its decompression) is also provided by 
the functionality of the applet Where the data has been 
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stored in. for example, a MIDI format (see FIG. 10), 
decompression instructions are an applet component. 
The authentication process as well as the associated 
activation of keys are also functionalities provided by 
the applet. 5 

The functionality 116 instructions also act as an 
interface 1 18 to provide access to the server via com- 
mon object request broker architecture (CORBA) (cf. 
httpy/www.omg.org). This is the open standard by 
which authentication and messaging between a Kara- io 
oke terminal and any server will communicate. When a 
song selection is made by the user, instructions 116 
makes a request of the server. In responding, the sys- 
tem is able to keep track of how many times a particular 
song was requested. In this way, the vendor is able to is 
keep track of the royalties due to the artist, the market 
demographics by region and thus age and income level 
so that pricing structures can better reflect the actual 
playing of the song. The interface with the server 118 
can cause prompts for the user at the graphical user 20 
interface (GUI) 122. Moreover, once a user has 
accessed the page 10 and applets are being down- 
loaded, the interface 118 can signal to bring in more 
applets at appropriate times, for example, to offer cou- 
pons for goods or services which can be printed on the 25 
user's printer or electronically stored for use on-line or to 
make other offers such as concert tickets or entries into 
contests. In this manner data request box 124 makes 
the request to the server so that another applet is sub- 
sequently downloaded on the user's system to satisfy 30 
the request. 

Depending upon the circumstances, a user will 
either request a song or request a series of songs. Turn* 
ing to FIG. 7, a flow chart is shown providing for the 
simultaneous play and search capability of this inven- 36 
tion. The song list 12 (see FIG. 2) is review by the user 
and the user makes a song selection at box 126. A 
prompt for the next song selectfon is provided at box 
128. The user may make the selection to que the song 
at box 132. If the user chooses not to make the next 40 
selection, the chosen song plays or continues to play at 
box 134. While the song continues to play, the selection 
prompt is still available to the user so that he/she may 
make the next song choice before the first song is over 
or at its completion at box 1 36. In the event the first song 4S 
is still playing, the next song is put into a song que at 
box 132. In the event that the first song is completed 
and no other song choices are made, then the program 
is complete at box 138. This process, as shown in FIG. 
7. can be repeated so that a user can que an entire so 
song repertoire before the activation of the first play or 
while the play is proceeding. In the meantime, as dis- 
cussed atxive, the vendor may have updated the song 
list and new applets are being downloaded to the user's 
system so that song choices are Mpdated in a seamless ss 
manner. 

As discussed above with reference to FIG. 4, this 
invention includes instructions to generate multimedia 



content output including audio output from an audio 
data element, ASCII output from an ASCII data element 
and graphics output finom a graphics data element, 
wherein the ASCII output and the graphics output are 
displayed on a display apparatus, the combination of 
which is delivered in a synchronized manner with the 
audio output in accordance with a timing data element. 
Also as mentioned above, the Karaoke applets run 
inside a browser, providing for the user selection of a 
song, downloads audio, downloads the video images, 
downloads the ASCII lyrics and downloads the timing 
data. Each download occurs using a separate thread of 
control for asynchronicity and better bandwidth usage. 
Pressing the "play" button causes the song to play 
Pressing the "stop" button halts the play Each time play 
is pressed, timing resynchronization with the words 
occurs. This invention can support multiple types of tim- 
ing synchronization providing varying qualities of serv- 
ice. Below, three types are discussed. 

Referring to FIG. 8, play Is Input by the user at box 
1 42. A check is made that all the audio, video, lyrics and 
time data are loaded at box 144. The audio data include 
any form of digital audio data , such as .au, .snd. .arff, 
ete. file formats. Audio data also includes MIDI format 
audio, and any compression of the audio. The video 
data include picture k>ased formats (.gif. .Jpg, etc.) and 
any other motion picture format data such as mpeg and 
.avi. The timing data defines the list of times that are 
associated with the vocalization of words within a song. 
The text data in botii single-byte and double-byte (inter- 
nationalized and localized fonts) of the words to a song. 

When a song begins to play, the start time is t^O 
and the increment number is n=0 at box 1 46. The incre- 
ment number is equal to the ASCII line number. An 
additional variatsle, x, represents the graphical output 
for highlighting and is linear with t and n. At this time, the 
audio, video and lyrics begin to playback on separate 
threads of control at box 148. A computation is then 
made to compute tiie beginning and the ending time 
(delta T) of tiie highlight for an ASCII line associated 
with n at box 152 so that tiie highlight of a line of lyrics 
is simultaneously provided in a manner linearly propor- 
tional to delta T at box 154. To move onto tiie next line 
number, increment line number (n++) at box 156. For 
each line n Nghllghted, a data block of audio n is played. 
After a sufficient number of increments of n, the system 
asks whether the song is done at box 158. If it is. the 
play stops at box 162. If the song is not done, it loops 
back to box 152. Alternatively, if stop had been pressed 
at any time at box 164. the audio and video would stop 
at box 166. 

Where it is possible to fragment the audio ASCII 
and graphical highlighting into pieces, synchronization 
between lyric highlighting and the words playing is bet- 
ter enabled. The increment number n counts the data 
fragments. The data is fragmented into equal sized data 
blocks, each having a delivery time equal to T. Turning 
to FIG. 9, in this way. at box 172, one line of lyrics Is 
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fragmented so that it Is in sync with one piece of the 
audio component (delta T) so that the synchronization 
of the two Xak&B effect for that particular delta T Addi- 
tionally, thie graphical output x is also fragmented to 
match word for word the audio output with the ASCII 
output. At box 1 74, the content is delivered accordingly. 
At box 1 76, the line Is incremented by one fragment and 
the process returns to box 172 until the song is com- 
pleted. In this way, if there is a defect in the data produc- 
ing the equivalent of a skip In the music, then the tinting 
will still be resynchronlzed at the next t=0. 

Where the MIDI standard is incorporated into the^ 
timing process of this invention as shown in FIG. 10, at 
box 178 the system checks that all the MIDI audio, 
video, lyrics and graphics are loaded (no separate tim- 
ing data thread is needed). The process begins at t=0 
and n^O at box 179 where n is defined by the MIDI 
standard. At box 182. the MIDI audio is played and the 
time of execution is retrieved from MIDI API at kxix 184. 
Accordingly, the proper word of proper line to highlight is 
computed by MIDI algorithms at box 186. If the song is 
done, the system ends the procedure. If not, the system 
loops back to box 1 82. 

Accordingly, a seamless multimedia experience is ' 
provided in that each elements' timing is coordinated 
with the other elements' timing. According to this inven- 
tion, an applet can include multimedia elements which 
Include timing codes or the data can be configured as 
per a standard like MIDI for the synchronized delivery of 
the multimedia elements. Applications for this Invention 
include noise dependent games (such as mechanical, 
such as panchiko or vkieo games, such as Pacman or 
SkyBlaster) or customizable games, where the visual 
aspects of the game must be synchronized with the vis- 
ual components to resemble mechanical variations of 
the game. For example, the visual components of the 
game panchiko include metal balls which move in a ver- 
tical feshion, their clanking representable by synchro- 
nized audio components. In such a case the variables 
discussed in reference to FIQ. 9 would include audio, 
visual and ASCII as well which Is preprogrammed to 
represent output based on a user's input (game play- 
ing). Moreover, other gambling games such as slot 
machines may be implemented in accordance with this 
invention where the mechanical operation is visual com- 
ponent and the associated mechanical noises are the 
audio components. The ASCII data is in the form, for 
example, of winnings which could be applied as a credit 
to one's credit card or PCMCIA-based card. 

Server systems and subsystems incorporating fea- 
tures of this invention can be implemented entirely in 
hardware, or in a combination of hardware and software 
(i.e., program modules stored in memory). For example, 
the browser erhbedded component or applet can be 
implemented entirely in software. Suitable media for 
server software include, for example, magnetk; media 
80 (See FIQ. 1) (ag., disks and tapes), optical media 
(e.g., CD-ROMs), DRAMs and SRAMs. In addition, soft- 
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ware can either be pre-loaded Into the server system or 
loaded by the user electronically with or witiiout the use 
of tangible storage media, e.g., by downloading pro- 
gram modules to the user's server from ftp/lelnet or html 
sites on the Internet or Worldwide Web. respectively. 

Thus, program modules Incorporating features of 
tiie invention can be conveniently distributed t>y CD- 
ROM, fbr example, or by accessing a Web site. In tiie 
latter case, the modules are typically loaded temporarily 
from permanent storage into RAM and/or output buffers 
of the Web server; i.e.. these are the media serving to 
store and distribute the program modules of tiie inven- 
tion whenever a download request is made. After load- 
ing into RAM. the Web server transmits tiie program 
modules to the user^ host. 

Claims 
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A system for providing on-line multimedia content 
output to a user on said user's computer system, 

comprising: 

a browser configured to provide access to a 
page and at least one component wherein said 
at least one component has multimedia audio, 
graphics, text and timing data elements and 
wherein said component further includes 
iristructions which when executed synchronize 
the delivery of said multimedia data elements; 
a transmitter configured to automatically down- 
load said at least one component to said user's 
computer system including a display appara- 
tus: and 

an execution unit configured to execute said 
instructions to generate multimedia content 
output including audio output from said audio 
data element, text output from said text data 
clement and graphtes output from said graph- 
ics data element, said text output and sakJ 
graphics output being displayed on said display 
apparatus of said user's computer system, the 
combination of which being delivered in a syn- 
chronized manner with said audio output in 
accordance with said timing data element 

A system as recited in Claim 1 wherein said audio 
output is in the form of a song having words. 

A system as recited in Claim 2 wherein said text 
output is in the form of ASCII words. 

A system as recited In Claim 2 wherein said text 
output is in the form of Japanese characters. 

A system as recited In Claim 3 wherein said graph- 
ics output is in the form of highlights on sakl words 
wNch are displayed on said display apparatus In a 
synchronized manner with said audio output words 
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in aocordance with said tirrting element 

6. A system as recited in Claim 1 wherein said graph- 
ics output Is in the form of a panchiko game having 
metal balls which is displayed on said display appa- s 
ratus. 

7. A system as recited in Claim 6 wherein said audto 
output is resembles the sound of metals balls 
clanging, such audio output delivered in a synchro- io 
nized manner with said graphics output in accord- 
ance with said timing element. 

8. A system as recited in Claim 1 wherein said at least 
one component includes encrypted data and unen- is 
crypted data and authentication Instructions exe- 
cutable with respect thereto, said system further 
including: 

a display unit configured to display unen- 20 
crypted data in a manner which enables said 
user to make a multimedia content output 
choice; 

an output unit configured to generate on said 
display unit a representation of unencrypted ss 
data in a manner which enables a user to make 
a multimedia content choice and an authentica- 
tion request: 

a processor configured to generate a multime- 
dia content output choice and an authentication 30 
request; 

an execution unit configured to execute said 
request for authentication in order to provide a 
key to decrypt some of said encrypted data to 
generate multimedia content output therefrom; 3S 
a receiver configured to receive said auttienti- 
cation; and 

a processor configured to generate rmiltimedia 
content output. 

40 

9. A system as recited in Claim 1 wherein said audio 
data element Is fragmented into audio fragments 
having delta time in length and wherein said text 
data element is fragmented into text fragments hav- 
ing delta time in length, said system further com- 4s 
prising: 

a generator configured to generate simultane- 
ous output of audio fragments and text frag- 
ments at the beginning of said delta time. so 

1 0. A system as recited in Claim 1 wherein said compo- 
nent is an applet 

11. A system as recited in Claim 1 wherein saM text ss 
output further includes a list of songs from which a 
user can choose, and wherein saki execution unit is 
further configured to allow said user to choose 



songs from said list so that said delivery of said 
songs* multimedia data elements is queued for 
sequential delivery. 

12. A mettiod for provkJing on-line multimedia content 
output to a user on said user's computer system, 
oonprieing tiie steps of: 

via a browser, providing access to a page and 
at least one component wherein said at least 
one component has a plurality of elements 
including multimedia audio, graphics, text and 
timing data elements and wherein said compo- 
nent further includes instructions whk;h when 
executed synchronize the delivery of said mul- 
timedia content data elements to said user^ 
computer system; 

automatically downloading said at least one 
component to said user's computer system; 
and 

executing said instructions to generate multi- 
media content output including audio output 
from said audio data element In the form of a 
song having words, text output from saki text 
data element being displayed on a display 
apparatus and graphics output from said 
graphics data element t>eing displayed on said 
display apparatus in the form of highlights on 
said text in a synchronized manner with said 
audio output in accordance with said timing 
data element 

13. A method as redted in Claim 12 wherein said at 
least one component includes encrypted data and 
unencrypted data and autiientication instructions 
executable witii respect thereto, saM prior to said 
executing step, method furtiier including the steps 
of: 

displaying unencrypted data in a manner which 
enables saki user to make a multimedia con- 
tent output choice; 

generating on said display apparatus a repre- 
sentation of unencrypted data in a manner 
which enatTles a user to make a multimedia 
content choice and an authentication request; 
generating a multimedia content output choice 
and an authentication request: 
executing said request for autherrtication in 
order to provide a key to decrypt some of said 
encrypted data to generate multimedia content 
output therefrom; 
receiving saki authentication; and 
generating multimedia content output 

14. A method as recited in Claim 12 wherein saM audio 
data element is fragmented into audio fragments 
having delta time In length and wherein said text 
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data element is fragmented into text fragments hav- 
ing delta time In length, said method further com- 
prising the step of: 

simulteneously outputting said audio fragments 5 
and text fragments at the beginning of said 
delta time. 

15. A method as recited in Claim 12 wherein said text 
output is In the form of ASCII words. io 

16. A method as recited in Claim 12 wherein said text 
output is in the form of Japanese characters. . 

17. A browser embedded component, comprising: 16 

multimedia audio, graphics, text and timing 
data elements; 

instructions which when executed synchronize 
the delivery of said multimedia data elements; 20 
and 

an execution element configured to execute 
said instructions to generate multimedia con- 
tent output including audio output from said 
audio data element, text output from said text 25 
data element and graphics output from said 
graphics data element, said text output and 
said graphics output being configured for dis- 
play on a display apparatus, the combination of 
which being delivered in a synchronized man- 30 
ner with said audio output in accordance with 
said timing data element 

18. An embedded component as recited in Claim 17 
wherein said audio output when generated is in the 35 
form of a song having words. 

19. An embedded component as recited in Claim 17 
wherein said text output when executed is in the 
form of ASCI I words. 40 

20. An embedded component as recited in Claim 17 
wherein said text output is In the form of Japanese 
characters. 

45 

21. An embedded component as recited in Claim 17 
wherein said graphics output when executed is in 
the form of highlights on said text output which are 
configured to be displayed on a display apparatus 

in a synchronized manner with said audio output so 
words In accordance with said tinting element 

22. An en^edded component as recited In Claim 17 
wherein said graphics output when executed is in 
the form of a panchiko game having metal bails ss 
which is configured to be displayed on a display 
apparatus. 



23. An embedded component as recited in Claim 17 
wherein said audio output when executed resem- 
bles the sound of metals balls clanging, such audio 
output delivered in a synchronized manner with 
said graphics output in accordance with said timing 
element. 

24. An embedded component as recited in Claim 17 
wherein said audio data element is fragmented into 
audio fragments having delta time in length and 
wherein said text data element is fragmented into 
text fragments having delta time in length, said 
component furtiier comprising: 

an execution unit configured to provide the 
simultaneous output of audio fragments and 
text fragments at the beginning of said delta 
time. 

25. A method for providing to a user, on said user's 
computer . system, on-line access to multimedia 
content, comprising the steps of: 

via a browser, providing access to a page con- 
taining at least one component wherein said at 
least one conponent includes encrypted and 
unencrypted data and Instructions execut€dt>le 
with respect thereto; 

automatically downloading said at least one 
cqnrponent to said user's computer system; 
displaying on a display apparatus a representa- 
tion of unencrypted data in a manner which 
enatdes a user to mal^ a multimedia content 
output clioice: 

generating a multimedia content output choice 
and an authentication request; 
said instructions executing said request for 
authentication in order to provide a key to 
decrypt some of said encrypted data to gener- 
ate multimedia content output therefrom; 
receiving said autiientication; and 
generating said multimedia content output. 

26. A method as recited in Claim 25 wherein said mul- 
timedia generating step comprises the following 
steps: 

storing and delivering multimedia audio, graph- 
ics, text and timing data elements; 
storing and delivering instructions which when 
executed synchronize the delivery of said mul- 
timedia data elements; and 
executing said instructions to generate multi- 
media content output Including audio output 
from said audio data element, text output from 
said text data element and graphics output 
from said graphics data element, said text out- 
put and said graphics output being displayed 
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on a display apparatus, the combination of 
which being delivered in a synchronized man- 
ner with said audio output in accordance with 
said timing data element. 

27. A system for providing on-line multimedia content 
output to a user on said user's computer system, 
comprising. 



28. A system as recited in Claim 27 wherein said 
graphics output is in the fbrm of highlights on said 
words which are configured to be displayed on a 
display apparatus in a synchronized manner with 3S 
said audio output words in accordance with said 
timing element. 

29. A system as recited in Claim 27 wherein said audio 
data element is fragmented into audio fragments 4o 
having delta time in length and wherein said text 
data element is fragmented into text fragments hav- 
ing delta time In length, said system further com- 
prising: 

45 

output means for the simultaneous output of 
audio fragments and text fragments at the 
beginning of said delta time. 

30. A system as recited in Claim 27 wherein said text so 
output further includes a list of songs from which a 
user can choose, and wherein said execution 
means further executed instruction which allow said 
user to choose songs from said list so that said 
delivery of said songs' multimedia data elements is ss 
queued for sequential delivery 

31. A server, comprising: 



a storage unit configured to store a browser 
embedded component, including multimedia 
audio, graphics, text and timing data elements, 
instructions which when executed synchronize 
the delivery of said multimedia data elements; 
and an execution element configured to exe- 
cute said instructions to generate multimedia 
content output including audio output from said 
audio data element, text output from said text 
data element and graphics output from said 
graphics data element, said text output and 
said graphics output being configured fbr dis- 
play on a display ap|3aratu8, the combination of 
which being delivered in a synchronized man- 
ner with said audio output in accordance with 
said timing data element; and 
a transmitter configured to transmit said 
browser embedded component from said stor- 
age unit to a remote computer system. 

32. A server as recited in Claim 31 wherein upon exe- 
cution by said execution element, said graphics out- 
put is in the form of highlights on said words which 
are configured to be displayed on a display appara- 
tus in a synchronized manner with said audio out- 
put words in accordance with said timing elemerrt. 

33. A server as recited in Claim 31 wherein said audio 
data element is fragmented into audio fragments 
having delta time In length and wherein said text 
data element is fragmented into text fragments hav- 
ing delta time in length wherein said execution ele- 
ment further comprises: 

a generator configured to generate simultane- 
ous output of audio fragments and text frag- 
ments at the beginning of said delta time. 

34. A computer system, comprising: 

a transmission reception unit configured to 
receive data and instructions from a remote 
source; 

a storage unit configured to store said data and 
instruction which are part of a browser embed- 
ded conponent which Is automatically down- 
loaded thereto upon access to a page provided 
by said remote source, said browser embed- 
ded component including multimedia audio, 
graphics, text and timing data elements, and 
wherein said insfaxictions when executed syn- 
chronize tiie delivery of said multimedia data 
elements; and an execution element config- 
ured to execute said instructions to generate 
multimedia content output including audio out- 
put from said audio data element, text output 
from said text data element and graphics out- 
put from said graphics data element, said text 



browser means for providing access to a page io 
and at least one component wherein said at 
least one component has multimedia audio, 
graphics, text and timing data elements and 
wherein said component further includes 
instructions which when executed synchronize is 
the delivery of said multimedia data elements; 
downloading means for automatically down- 
loading said at least one component to said 
user's connputer system; and 
execution means for executing said instructions 20 
to generate multimedia content output includ- 
ing audio output from said audio data element, 
text output from said text data dement and 
graphics output from said graphics data ele- 
ment, said text output and said graphics output 2S 
being configured to be displayed on a display 
apparatus, the combination of which being 
delivered in a synchronized manner with said 
audio output in accordance witii scUd timing 
data element. 30 
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output and said graphics output being config- 
ured for display on a display apparatus, the 
combination of which being delivered in a syn- 
chronized manner with said audio output in 
accordance with said timing data element. 5 

35. A computer system as recited in Claim 34 wherein 
upon execution by said execution element, said 
graphics output is in the form of highlights on said 
words which are configured to be displayed on a 10 
display apparatus in a synchronized manner with 
said audio output words in accordance with said 
timing element. 

36. A computer system as recited in Claim 34 wherein is 
said audio data element is fragmented into audio 
fragments having delta time in length and wherein 
said text data element is fragmented into text frag- 
ments having delta time in length wherein said exe- 
cution element further comprises: 20 

a generator configured to generate simultane- 
ous output of audio fragments and text fi^ag- 
ments at the beginning of said delta time. 

SB 

37. A computer system as recited in Claim 34 wherein 
said browser embedded component is an applet. 

38. A conputer-readat)le medium having computer 
readable code stored tiierein, comprising: 30 

a computer-readable code module configured 
to store multimedia audio, graphics, text and 
timing data elements and instructions which 
when executed synchronize the delivery of said ss 
multimedia data elements, and configured to 
execute said instructions to generate multime- 
dia content output including audio output from 
said audio data element text output from said 
text data element and graphics output from 40 
said graphics data element said text output 
and said graphics output being configured for 
display on a display apparatus, the combina- 
tion of which being delivered in a synchronized 
manner with said audio ouput in accordance 4S 
with said timing data element 

39. A computer readable medium as redted in Claim 
38 wherein said audio output when generated is in 

the form of a song having words, so 

40. A computer readable medium as recited in Claim 
38 wherein said text output when executed is in the 
form of ASCII words. 

ss 

41. A computer readable medium as recited In Claim 
38 wherein said text output is in the form of Japa- 
nese characters. 



42. A computer readable medium as recited in Claim 
38 wherein said graphics output when executed is 
in the form of highlights on said text output which 
are configured to be displayed on a display appara- 
tus in a synchronized manner with said audio out- 
put words In accordance with said timing element 

43. A computer readable medium as recited in Claim 
38 wherein said graphics output when executed is 
In the form of a panchiko game having metal balls 
which is configured to be displayed on a display 
apparatus. 

44. A computer readable medium as recited in Claim 
38 wherein said audio output when executed 
resembles the sound of metals balls clanging, such 
audio output delivered in a synchronized manner 
with said graphics output in accordance with said 
timing element. 

45. A computer readable mediuhi as recited in Claim 
38 wherein said audio data element is fragmented 
into audio fragments having delta time in length and 
wherein said text data element is fragmented into 
text fragments having delta time in length, said 
component further comprising: 

an execution unit configured to provide the 
simultaneous output of audio fragments and 
text fragments at the beginning of said delta 
time. 
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